Learning Term Embeddings for Taxonomic Relation Identification Using Dynamic Weighting Neural Network

نویسندگان

  • Anh Tuan Luu
  • Yi Tay
  • Siu Cheung Hui
  • See-Kiong Ng
چکیده

Taxonomic relation identification aims to recognize the ‘is-a’ relation between two terms. Previous works on identifying taxonomic relations are mostly based on statistical and linguistic approaches, but the accuracy of these approaches is far from satisfactory. In this paper, we propose a novel supervised learning approach for identifying taxonomic relations using term embeddings. For this purpose, we first design a dynamic weighting neural network to learn term embeddings based on not only the hypernym and hyponym terms, but also the contextual information between them. We then apply such embeddings as features to identify taxonomic relations using a supervised method. The experimental results show that our proposed approach significantly outperforms other state-of-the-art methods by 9% to 13% in terms of accuracy for both general and specific domain datasets.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Identification of Wind Turbine using Fractional Order Dynamic Neural Network and Optimization Algorithm

In this paper, an efficient technique is presented to identify a 2500 KW wind turbine operating in Kahak wind farm, Qazvin province, Iran. This complicated system dealing with wind behavior is identified by using a proposed fractional order dynamic neural network (FODNN) optimized with evolutionary computation. In the proposed method, some parameters of FODNN are unknown during the process of i...

متن کامل

Iterative learning identification and control for dynamic systems described by NARMAX model

A new iterative learning controller is proposed for a general unknown discrete time-varying nonlinear non-affine system represented by NARMAX (Nonlinear Autoregressive Moving Average with eXogenous inputs) model. The proposed controller is composed of an iterative learning neural identifier and an iterative learning controller. Iterative learning control and iterative learning identification ar...

متن کامل

Learning Term Embeddings for Hypernymy Identification

Hypernymy identification aims at detecting if isA relationship holds between two words or phrases. Most previous methods are based on lexical patterns or the Distributional Inclusion Hypothesis, and the accuracy of such methods is not ideal. In this paper, we propose a simple yet effective supervision framework to identify hypernymy relations using distributed term representations (a.k.a term e...

متن کامل

CogALex-V Shared Task: CGSRC - Classifying Semantic Relations using Convolutional Neural Networks

In this paper, we describe a system (CGSRC) for classifying four semantic relations: synonym, hypernym, antonym and meronym using convolutional neural networks (CNN). We have participated in CogALex-V semantic shared task of corpus-based identification of semantic relations. Proposed approach using CNN-based deep neural networks leveraging pre-compiled word2vec distributional neural embeddings ...

متن کامل

Dynamic Multi-optimal Learning Rates For Neural Network

This paper presents a method called dynamic multi-optimal learning rates for neural network (NN) with backpropagation (BP) training. The stability analysis of the learning rates for a 3-layer NN to minimize the total square error is included. The optimal learning rates can be obtained by using proper numerical method. These optimal learning rates are then applied to BP training to tune the corr...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2016